An Efficient MapReduce Computing Model for Imprecise Applications

An Efficient MapReduce Computing Model for Imprecise Applications

Changjian Wang, Yuxing Peng, Mingxing Tang, Dongsheng Li, Shanshan Li, Pengfei You
Copyright: © 2016 |Volume: 13 |Issue: 3 |Pages: 18
ISSN: 1545-7362|EISSN: 1546-5004|EISBN13: 9781466689060|DOI: 10.4018/IJWSR.2016070103
Cite Article Cite Article

MLA

Wang, Changjian, et al. "An Efficient MapReduce Computing Model for Imprecise Applications." IJWSR vol.13, no.3 2016: pp.46-63. http://doi.org/10.4018/IJWSR.2016070103

APA

Wang, C., Peng, Y., Tang, M., Li, D., Li, S., & You, P. (2016). An Efficient MapReduce Computing Model for Imprecise Applications. International Journal of Web Services Research (IJWSR), 13(3), 46-63. http://doi.org/10.4018/IJWSR.2016070103

Chicago

Wang, Changjian, et al. "An Efficient MapReduce Computing Model for Imprecise Applications," International Journal of Web Services Research (IJWSR) 13, no.3: 46-63. http://doi.org/10.4018/IJWSR.2016070103

Export Reference

Mendeley
Favorite Full-Issue Download

Abstract

Optimizing the Map process is important for the improvement of the MapReduce performance. Many efforts have been devoted into the problem to design more efficient scheduling strategies. However, there exists a kind of MapReduce applications, named imprecise applications, where the imprecise results based on part of map tasks can satisfy the requirements of imprecise applications and thus the job processes can be completed when enough map tasks are processed. According to the feature of imprecise applications, the authors propose an improved MapReduce model, named MapCheckReduce, which can terminate the map process when the requirements of an imprecise application is satisfied. Compared to MapReduce, a Check mechanism and a set of extended programming interfaces are added to MapCheckReduce. The Check mechanism receives and analyzes messages submitted by completed map tasks and then determines whether to terminate the map phase according to the analysis results. The programming interfaces are used by the programmers to define the termination conditions of the map process. A data-prefetching mechanism is designed and implemented in MapCheckReduce which can improve the performance of MapCheckReduce effectively. The MapCheckReduce prototype has been implemented and experiment results verify the feasibility and effectiveness of MapCheckReduce.

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.